Derivation of Hebb's rule
نویسندگان
چکیده
On the basis of the general form for the energy needed to adapt the connection strengths wij of a network in which learning takes place, a local learning rule is found for the changes ∆wij . This biologically realizable learning rule turns out to comply with Hebb’s neurophysiological postulate, but is not of the form of any of the learning rules proposed in the literature. The learning rule possesses the property that the energy needed in each learning step is minimal, and is, as such, evolutionary attractive. Moreover, the preand post-synaptic neurons are found to influence the synaptic changes differently, resulting in a asymmetric connection matrix wij , a fact which is in agreement with biological observation. It is shown that, if a finite set of the same patterns is presented over and over again to the network, the weights of the synapses converge to finite values. Furthermore, it is proved that the final values found in this biologically realizable limit are the same as those found via a mathematical approach to the problem of finding the weights of a partially connected neural network that can store a collection of patterns. The mathematical solution is obtained via a modified version of the so-called method of the pseudo-inverse, and has the inverse of a reduced correlation matrix, rather than the usual correlation matrix, as its basic ingredient. Thus, a biological network might realize the final results of the mathematician by the energetically economic rule for the adaption of the synapses found in this article.
منابع مشابه
Derivation of conflict resolution rule-curves in multi-purpose multi-reservoir system for inter-basin water transfer during drought
متن کامل
A model of STDP based on spatially and temporally local information: Derivation and combination with gated decay
Temporal relationships between neuronal firing and plasticity have received significant attention in recent decades. Neurophysiological studies have shown the phenomenon of spike-timing-dependent plasticity (STDP). Various models were suggested to implement an STDP-like learning rule in artificial networks based on spiking neuronal representations. The rule presented here was developed under th...
متن کاملPerceptual learning: Insight in sight
The Hebbian synapse and Hebb learning rule are familiar to those working on biological and machine learning. But Hebb's insights from over fifty years ago carry many other lessons in learning and may contribute to a more parsimonious taxonomy of the mechanisms involved.
متن کاملThe Hebb Rule for Synaptic Plasticity: Algorithms and Implementations
In 1949 Donald Hebb published "The Organization of Behavior," in which he introduced several hypotheses about the neural substrate of learning and memory, including the Hebb learning rule or Hebb synapse. At that time very little was known about neural mechanisms of plasticity at the molecular and cellular levels. The primary data on which Hebb formulated his hypotheses was Golgi material, prov...
متن کاملThe Development of Vlsi Implementation-related Neural Network Training Algorithms
Artificial neural networks are systems composed of interconnected simple computing units known as artificial neurons which simulate some properties of their biological counterparts. They have been developed and studied for understanding how brains function, and for computational purposes. Two kinds of architecture of Neural Network Models(NNMs) are the most popular, Recurrent and Feed-forward. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1999